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Abstract. Let G be a permutation group acting on {1, ... , n}, and < be any 
admissible term order on the polynomial ring K[xi , . . . , x n ] . We prove that 
the invariant ring HC[:ri , . . . , Xn ] of G has a finite SAGBI basis if, and only if, 
G is generated by reflections. 



1. Introduction 

Let K be a field (or a ring). Let G be a permutation group on {1, . . . ,n}. Let 
V := K n , and x := [x\, . . . , x n ) be the canonical basis of the dual of V. The 
invariant ring K[x] G of G is the graded subalgebra of the polynomials of K[x] :— 
K[xi , . . . , x n ] which are invariant for the natural action of G on the variables. Given 
a vector 11 e N", we denote by x u the monomial a;" 1 • • -x™". The orbit sum o(x u ) 
of a monomial x u is the sum of all the monomials in the G-orbit of x u . Given a 
subset S of {1, . . . , n}, we denote by 6(S) the symmetric group of all permutations 
of S and by ed(S) the d-th elementary symmetric polynomial in the corresponding 



variables J2(i 1 <---<i d )es d x ii 

We recall the definition of a SAGBI basis (Subalgebra Analog of a Grobner Basis 
for Ideals) [KM89, RS9QJ, which provides a useful device in the computational study 
of invariant rings of permutation groups Thiol . Given an admissible term order < 
on K[x], we denote by in<(K[a;] G ) the monoid of all initial monomials of invariants 
in K[x] G . For a permutation group, this can also be defined as the monoid of all 
monomials x u such that x u > g.x u for all jeG. By abuse of notations, we also 
denote by in<(K[a;] G ) the initial algebra of K[x] G , which is the linear span of those 
monomials. A SAGBI basis of K[x] G is a subset S of invariants in K[x] G whose 
initial monomials generates in<(IK[x] G ) as an algebra. It follows in particular that 
S generates K[a;] G as an algebra. A monomial x u S in<(K[izi] G ) is irreducible if it 
cannot be decomposed as a product of two non-trivial monomials of in< (K[a;] G ) (this 
definition generalizes for any monoid). If x u is irreducible, then any SAGBI basis of 
in<(K[a;] G ) must contain a polynomial having x u as initial monomial. The set of all 
orbit sums of irreducible monomials is actually the minimal reduced SAGBI basis 
of in < (IK[.'E] G ). We refer for example to ELD.SZ1 iStu96j for further background on 
invariant rings, term orders, and SAGBI bases. 

As opposed to Grobner bases, SAGBI bases need not be finite, and it is an 
important problem to classify the algebras which have a finite SAGBI basis for 
some term order |Stu96| . In this article we complete this classification for invariant 
rings of permutation groups in their permutation basis. 

Let Si, . . . , S r be the orbits of G on the variables, and E be the set of the n 
elementary symmetric polynomials 

(ei(Si), . . .,e| Sl |(5i), . . . ,ei(SV), • . . , e\ Sr \ (S r )). 
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Assume that G is generated by reflections (i.e. by transpositions); otherwise said, 
assume that G is the direct product ©(Si) x • • • x &{S r ) of the symmetric groups 
on its transitive components. Then, it is well known that not only K[x] G is the 
polynomial ring in E, but E is a comprehensive SAGBI basis of K[a;] G , that is a 
SAGBI basis of E for any admissible term order. 

In |Gob98| . M. Gobel proved that these are the only permutation groups with a 
finite SAGBI basis with respect to the lexicographic term order. 

Theorem 1.1. Let G be a permutation group acting on {1, ...,«.}, and <i cx be 
the lexicographic term order on K[x]. Then, the invariant ring K[or] has a finite 
SAGBI basis with respect to <\ cx if, and only if, G is generated by reflections. 

In |Goh99hl iGohflflal lOohno] . M. Gobel further conjectures that this result ex- 
tends to any admissible term order, and proves it for the alternating groups A n , 
and a few other groups. 

In this paper, we confirm this conjecture by proving the following theorem. 

Theorem 1.2. Let G be a permutation group acting on {1, . . . , n}, and < be any 
admissible term order on K[x]. Then, the invariant ring K[x] G has a finite SAGBI 
basis with respect to < if, and only if, G is generated by reflections. 

This result was also obtained independently by Z. Reichstein !Rei02j . as a corol- 
lary of a more general theorem on multiplicative invariants, as well as by Shigeru 
Kuroda iKurOj; . with some further generalizations. The techniques used in each 
cases are essentially the same, our proof being by far the shortest. 

Note that theorem 11.21 does not preclude the existence of a finite SAGBI basis 
for K[x] G = K[V] G when the dual basis of V is not one of its permutation basis. 
Consider, for example, the cyclic group C3 = ^3 acting by permutation on the 
variables x\, x 2 ,xz in characteristic 3. In the basis y\ := £1,2/2 := £2 — £1,2/3 := 
X3 — 2x2 + xi, the invariant ring F 3 [x] G3 = F3[T^] G3 = F 3 [jyi, y 2 , ys} 03 has a finite 
SAGBI basis w.r.t. the degree reverse lexicographic order with yi < y 2 < 2/3 [SW02 j . 
Thus, classifying the invariants rings of permutation groups which have a finite 
SAGBI basis for some term order in some basis remains an open problem. 

The paper is organized as follows. In section 2, we show that, if a convex cone 
C of R + ™ is not closed for the usual topology, then its monoid of integer vectors 
(vectors with nonnegative integer coordinates) contains infinitely many irreducible 
elements. In section 3, we describe the monoid in<(IK[x] G ) as the monoid of integer 
vectors of a suitable convex cone C< (G) of ]R + ™, and prove theorem ll.2l bv showing 
that this convex cone is not closed when G is not generated by reflections. This 
last step relies on an explicit and fairly simple construction of a line segment in C 
with an extremity not in C. 

2. Convex cones 

Let R + be the set of non-negative real numbers. We call convex cone a subset 
C of E+" such that \u + fiv e C for all u,v in C and A, [i in R + . In particular, 
C is a monoid for +. Its integral cone M(C) := C n N™ is the submonoid of the 
integer vectors of C. An element of M(C) is irreducible if it cannot be decomposed 
as the sum of two non-trivial elements of M{C). Obviously, the set of irreducible 
elements of M{C) is a minimal generating set for M(C). 

Lemma 2.1. Let C be a convex cone which spans R™ as a vector space, and is 
not closed for the usual topology o/M™. Then, its integral cone M(C) has infinitely 
many irreducible elements. 

Proof. Let v\, . . . , v n be a subset of M(C) which spans R™ as a vector space. As- 
sume M(C) is generated by a finite set S of integer vectors, and let (S) be the 
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convex subcone of C spanned by S. This subcone is a closed subset of R n , Hence, 
C\{S) is non-empty. Let v$ be a vector of C\(S), and consider the convex hull 
O := {A ^o + Ai«i + • • • + X n v n , < Xi < 1}, which is both open and contained in 
G. Since vq is in the closure of O, and (S) is closed, 0\(S) is non-empty, open and 
included in C. Hence, C\(S) has a non-empty interior. 

Now, we can take an open ball B(u,e) of center u and radius e > in C\(S). 
The open ball B(^-u, y/n) still lies in C\(S), but also contains an integer vector 
p. This vector p cannot be generated by S, which is the desired contradiction. □ 

As a first application, we verify one of the very first results on SAGBI basis, 
namely that the invariant ring K[a:] A3 of the alternating group A 3 on 3 elements 
has no finite SAGBI basis with respect to the lexicographic term order with x\ > 
x 2 > X3. Let x u := x^x^x^ 3 be a monomial. Then, x u is initial if, and only if, 

(ui,u 2 ,u 3 ) >io X («2)«3,«i) and (ui,u 2 ,u 3 ) >i cx (u 3 ,ui,u 2 ), 

which we can rewrite as 

(tti - u 2 , u 2 - u 3 , it 3 - mi) >i ox (0, 0, 0) and (tti - u 3 , u 2 -Ux,u 3 - u 2 ) >i cx (0, 0, 0). 

We define the initial cone C to be the convex cone of all vectors of R +3 satisfying 
those inequations, so that ini ox (K[a;]^ 3 ) is the integral cone of C. Note that G spans 
E™, since it contains the independent vectors (1,0,0), (1,1,0), and (1,1,1). 

Now, proving that Kfx]" 43 has no finite SAGBI basis for lex is immediate: (1, 0, 1) 
is not in C, whereas (1, 0, 1) + e(l, 0, 0) is in G for any e > 0; hence, C is not closed, 
and by lemma OTT1 inw (K[x] As ) has infinitely many irreducible elements. 

The general proof will follow exactly the same line. 

3. Infiniteness of SAGBI basis of permutation invariants 

Let < be an admissible term order on K[x]; without loss of generality, we may 
assume that Xi > x 2 > ■ ■ ■ > x n . By the classical characterization of admissible 
term orders (see [CL097J), there exists n linearly independent linear forms l\, . . . , l n 
in 1™ 1— > R such that x u > x v if, and only if, 

(h(u), . . . , l„(u)) >i cx (h(v), l n (v)). 

Then, a monomial x u is in the initial algebra in<(K[a;] G ) if, and only if, x u > g.x u , 
for all g S G, that is 

(h(u), . . .,/„(«)) >i ox (h(g.u), . . .,l„(g.u)), for all g e G 

We define the initial convex cone C := C < (K[x] G ) to be the convex cone of R + " 
defined by those inequations: 

(h(u - g.u), . . .,l„(u - g.u)) >i cx (0, ... ,0), for all g e G, 

so that ini ox (K[x] G ) is the integral cone of C. It is well known that any non- 
increasing monomial (monomial x u such that u\ > u 2 > ■ ■ ■ > u n ) is in C; it is 
the initial monomial of the corresponding symmetric function. Hence, (1, 0, . . . , 0), 
(1, 1, 0, . . . , 0), (1, . . . , 1) are in C, and C spans 1™ as a vector space. 
We now turn to the proof of theorem II .21 

Proof. Let G be a permutation group. Assume that C is closed, while G is not 
generated by reflections. Then, there exists a < b such that the transposition (a, b) 
is not in G, while a is in the G-orbit of b. Choose such a pair a < b with b minimal. 
We claim that there is no transposition (a', b) in G with a' < b. Otherwise, a 
and a' are in the same G-orbit, and by minimality of b, (a, a') £ G; thus, (a, b) — 
(a, a')(a', b)(a, a') e G. Pick g € G such that g.b = a, and define 

u t := ((ti - l)i, (n - 2)i, . . . , (n-b+ l)t, n - b, (n - b - l)t, . . . , t, 0). 



4 



NICOLAS M. THIERY AND STEPHAN THOMASSE 



Note that uq < g.Uo, so uq £ C, whereas u\ £ C . Furthermore, the entries of Ut 
are all distinct, except when t = for some a' < b, in which case the a'-th and 
6-th entries are equal. Since (a', 6) £ G, for any t, < t < 1, the orbit of Ut is of 
size |G|, and there exists a unique permutation a t £ G such that cr t .u t is in C. 

Let to = inf{t > 0, u t £ C}. If u to C, then u to is in the closure of C, but 
not in C, a contradiction. Otherwise, u ta £ C, and to > because u$ ^ C. For 
any permutation a, {a.ut,t > 0} is a half-line; so, C being convex and closed, 
I u := {i, er.itt € C} is a closed interval [x a ,y a ]. For example, /id = [iojl] £ [0,1]- 
Since the interval [0, 1] is the union of all the there exists a ^ id such that 
t £ I a . This contradicts the uniqueness of <7t . □ 

4. Conclusion 

Let a be a real number. The convex cone in R +2 of all [x, y) such that y > ax is 
a very simple geometrical object; yet, its integer monoid has a very rich structure, 
the irreducible elements being essentially the famous Sturm words. The very same 
phenomenon appears for SAGBI basis of permutation groups, and explains the 
tediousness of the ad hoc constructions of infinite sequences of irreducible elements 
in [G6b99b, G6b99a, GobOQj. Thus, the proof of theorem ll. 21 suggests that looking 
at the geometry of the initial convex cone is the proper tool to obtain further 
information on SAGBI basis of permutation groups. 
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